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1. INTRODUCTION 
Use the following formula to get the minimum of a continuously differentiable function: 


Min F(x), € R” (1) 
the iterative methods we use are iterative approaches of the following form: 
Xk+1 = Xk + Age (2) 


in (2) shows that various stepsizes A; and directions dx result in distinct approaches, as shown in [1]. For 
example, in the quadratic case, A; is an accurate step size as (3): 


T 
— _ Kk 3 
k Tadg (3) 


for further information, see [2]. After that, the step length A, is selected to meet the Wolfe conditions, which 
are as (4) and (5): 


Fara < Fe t+ dAggidy (4) 
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digr = adkgg (5) 


where 0< <œ < 1, see [3]. The search directions in conjugate gradient algorithms can be specified 
recursively: 


dk+1 = Seay + B Sg (6) 


where p, is selected in a way that d, and dp}, must satisfy the conjugacy property. To compute the scalar 
B pa number of formulae have been presented. Fletcher and Reeves (FR) [4] and Dai and Yuan (DY) [5] are 
two well-known formulae. They're provided by: 


BER = Shai 8k+1 BPE = Zirak (7) 
gree k di yg 


The other nonlinear conjugate gradient techniques, for example, are the subject of a lot of study in 
this area (e.g. see [6]-[9]). Many writers have researched the nonlinear conjugate gradient technique in recent 
years, particularly from the perspective of global convergence. The nonlinear conjugate gradient technique 
was often studied independently because its characteristics might vary greatly depending on fp (see Powell 


[10]). 

We'd want to close the new search direction to the quasi-Newton direction later because of the 
theoretical usefulness of quasi-Newton approaches. In this situation, we're looking for a parameter that will 
allow us to: 


-1 = 
—Qer18e+1 = Seri + Bese (8) 
where Qkg+1 is the Hessian matrix. (See [11], [12]) for a useful resource for research describing the most 
recent CG coefficients with notable results and numerous f, adjustments. The approaches are efficient in 
reality, according to numerical findings, and the methods’ convergence guarantees are comparable to the 
classical variations. Our key contribution is a novel coefficient derivation based on the second-order Taylor's 


series, which we utilized to build an inverse Hessian matrix for computing the search direction and ensuring 
global convergence. 


2. OUR NEW COEFFICIENT CONJUGATE 
A second order Taylor series is used to derive the new coefficient conjugate. Let we clarify: 


FO) = Fe) + gin (% — Kees) +E B- Bert)" OG) — Sera) (9) 
the F(x) has the following gradient: 

Br+1 = Br + QO Ke+1)$e (10) 
putting (3) in (9) and using ELS search, we get: 

SEO (Sera Se = Frrr — Fe) + 3/2 Agee en (11) 


the yielded matrix Q(X;41) can be as: 


(Fei Fg) +3/2Aggh 
Q (šk) = ae? en (12) 


putting Q (Xg+1) in (8) we get: 


b= (1 = SSK ) i (13) 
k Certa Fe)+3/2Aggk ee) seve 


We will do some algebra manipulations on (14), in order to achieve an ideal direction of descent: 
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T 
1 llygll? ) 
= — w 14 
Be = ghy- oE 5) ge 14) 
where: 
T: Te T 
= (RY) [see ___ 95 _ | (15) 
lyell? Lsgsg @Fr+1-Fr)+3/24ggk 8k 


this is the formale that will be utilized to do the convergence analysis. The application of optimization theory 
and methods to new formulations is a vast field of applied mathematics. The method described by is denoted 
by New (13). As follows, we suggest a novel conjugate gradient method. 


New Algorithm: 

1): Give x,ER". Set k=1 and d, =~—g,. If ligil < 1076, then, stop. 
2): Evaluate A, >0 satisfying a (4-5). 

3): Let Xk} = Xk +Akdk. If llg&kll < 10°, then come to a halt. 

4): Evaluate B, by the formulae (14) and dk}1 by (6). 

5): Let k=k+1 and continue with step 2. 


Theorem (2.2): Consider the CG technique (2), (4), (5), and the descent direction d,,, provided by (6) with 
(14) is adequate. 


2 
Proof: Since dọ = —g, we get dogo = -|ls ll < 0. Suppose that gi dy < 0 for all k En. To finish the 


proof, we must prove that the theorem holds for all k + 1. Because Q(X,41) is the quadratic model's search 
direction matrix, we may write it like this: 


(Feri—Fe)+3/2Aggh 
Q (Xr+) = Sinan = W Inxn (16) 


now, we have to prove that w > 0. Using Wolfe's condition for determining the value of w, we have: 


op = EE B43 /2ARGE BE 


SESK Cu 
since dig, < —cg/ gg, then, using the equation above, we obtain: 
+ 3/20 Bit ASB Be (18) 
SKSk 
because the first half of (18) is greater than the second, we get: 
w>0 (19) 


we may describe the search directions of the new approach as follows using (6) and (14) and some algebraic 
manipulations: 


T 
— _N-1 — SKS$R 
esa = Qe Be41 (Feri Fe +3/2Aggt ge Se41 (20) 


multiplying (20) by 241, we have: 


T 
T pao SKSK 2s 2 
dk+18k+1 = (Fesa-Fd+3/2Ang) ex lgeorll ollgerrll (21) 
since w > 0, from (17) we obtained: 
dkg = Z0 lge ll? S —ellgeaall? (22) 
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3. CONVERGENCE ANALYSIS 

To do this, establish the “global convergence” of new Algorithm is one of the most property of 
numerical algorithms, the assumptions must be made: The Q = {x E€ R"/F (x) < F(%;))} is a confined level 
set. The gradient of function g is Lipschitz continuous in some neighborhood A of Q, i.e., there exists, a 
constant, L > 0 such that: 


lg(o) — g()Il < Lllo — tI], Vo, tT EA (23) 


for more details see [8]. We show why the Dai et al. [13] theorem is crucial for determining global 
convergence. 


Lemma (3.1): Let x; be produced by (2), dẹ satisfy descent property and a, be satisfy (4-5). If: 


1 


do ima (24) 
then: 
jim inf ||ggi1ll = 0 (25) 


we began by stating our paper's key theorem. 


Theorem (3.2): Assume that F(x) meets Assumptions 1 and 2. Let {Xg} be the sequence that (6) generates 
(14). If Wolfe criteria (4) and (5) are satisfied by step size Àg, then: 


Jim inf Ilgell = 0 (26) 


Proof: Using (14) as an example of pp in (6), we get: 


2 
d == + New df < + I( S lyell ) lyell d 27 
devs ll | Serr + Pk zll ligg ll Yk SEY, Sk [sellllvel Idegll (27) 
and combining $, = A,d; , we get: 
Yglillgr+ ll+ællgr+ ly Ag+1+w 
derali < Ulgeeall + PeMssealto lss | < [e] syll (28) 
Agligll||ygll Ag 
which results in: 
1 Ag ]1 = 
Leir = ote] ple b= © (29) 


we may deduce from Lemma | that jim inf ||ggl| = 0 is identical to jim Ilezll = 0 for a uniformly convex 


function. 


4. NUMERICAL RESULTS 

On a series of unconstrained optimization test problems, this section shows the computing efficiency 
of a Fortran implementation of the novel CG technique and the FR-Algorithm. Readers who are interested 
can access the papers and references listed below ([14], [15]). The unconstrained concerns in [16] are the test 
problems. We investigated numerical experiments with 100 and 1000 variables for each test function for 15 
large scale unconstrained optimization problems in extended or generalized form. Many papers have 
proposed this method for optimization problems [17]-[20]. As for the papers, it is concerned with the 
convergence feature [21]-[24]. As a termination condition, we employ the inequality ||g,,,|| < 1076. The 
6 = 0.001 and o = 0.9 were used to evaluate both methods.The numerical findings are reported in Table 1. 
“The following are the definitions for each column: NI: the total number of iterations, NR: the total number 
of restart, NF: the total number of evelation functions”. Table 1 shows how many issues these algorithms 
have solved in terms of iterations (NI), restart (NR) and function evaluations (NF). 
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Table 2 shows that, overall, the tools score 100 percent for the FR-method, whereas the new 
approach (New) scores 22 percent NI, 23 percent NR, and 52 percent NF. “The results are shown in Figures 
1, 2 and 3. Note that a performance measure introduced by Dolan and More [25], [26] method was 
employed”. 


Table 1. The FR and new methods' numerical results 

FR algorithm New algorithm 
n NI NR NF NI NR NF 
Extended Rosenbrock 100 47 18 93 43 23 89 


P. No. 


Extended Beale 100 32 15 52 18 11 34 
1000 22 10 42 19 11 35 
Penalty 100 10 6 27 12 8 31 
1000 24 16 191 22 13 47 
Extended PSC1 100 15 9 31 11 7 23 
1000 8 6 17 8 6 17 
Extended Maratos 100 89 32 174 73 44 171 


Extended Q. Penalty 100 32 12 65 24 15 56 
Quadratic QF2 100 130 49 196 117 36 184 


ARWHEAD (CUTE) 100 9 4 18 10 6 18 


NONDIA (CUTE) 100 13 T 25 12 7 23 
1000 15 7 29 12 6 25 
Partial Quadratic 100 74 21 123 85 25 134 


Broyden Tridiagonal 100 30 10 49 28 6 49 
EDENSCH (CUTE) 100 69 50 1202 34 17 56 
LIARWHD (CUTE) 100 23 11 45 24 11 29 
DENSCHNA (CUTE) 100 20 11 33 18 11 30 
DENSCHNC (CUTE) 100 49 22 80 16 10 30 


Total 2002 818 6527 1569 633 3189 


Table 2. The Performance percentage for the new algorithm compared with FR method 
NI NR NF 
FR .100 % -100 % -100 % 
New 78.37% 771.38% 48.85% 


Figure 1. Performance measure based on the NI 
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Figure 3. Performance measure based on the NF 


CONCLUSION 
On the basis of the quadratic model, we proposed a unique conjugate gradient technique. The 


proposed technique satisfies both the descent and convergence requirements. According to the numerical 
data, the new strategy outperformed the FR-method in terms of the number of iterations, restart, and 
evaluation functions. In addition, the new method surpasses the previous FR. 
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